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Claims 

Method for the recognition and tracking of objects on the basis of 
images of at least one real object (16, 18) including depth resolved 
image points (26, 28, 28', 32, 33) detected in time sequence by at 
least one sensor (10) for an electromagnetic radiation, in particular a 
laser scanner, with the real object (16, 18) being in a detection range 
of the sensor (10), in which the following steps are carried out in se- 
quential cycles: 

at least one current object contour is formed from image points 
(26, 28, 28', 32, 33) of a current image, 

for objects in a preceding cycle at least one object contour is 
predicted in the current cycle starting in each case from an ob- 
ject contour associated with the respective object in the preced- 
ing cycle, 

for at least one of the objects a current position is determined 
from the current object contour and/or an object speed is de- 
termined from the current object contour (42) and the object 
contour in a preceding cycle. 

Method in accordance with claim 1, 
characterized in that 

for the formation of current object contours segments are formed 

from image points (26, 28, 28', 32, 33) of a current image; 

in that for each of the segments a segment contour (30) associated 

with the segment and its position are determined; 

in that one of the segment contours is compared with at least one of 

the predicted object contours with reference to the position and/or 
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the shape and in dependence of the result of a comparison the seg- 
ment corresponding to the segment contour is associated with one of 
the objects and in that current object contours (42) are respectively 
formed from the segments respectively associated with the segment 
contours of objects. 

Method in accordance with claim 1 or claim 2, 

in that contours are defined by a contour element or by a sequence of 
contour elements (30, 38, 42) and in that the contour element or data 
defining the contour elements (30, 38, 42) are determined from at 
least one image point (26, 28, 28', 32, 33) of a segment or contour 
elements of another contour. 

Method in accordance with claim 3, 
characterized in that 

the contour elements (30, 38, 42) respectively include position coor- 
dinates as data. 

Method in accordance with claim 3 or claim 4, 
characterized in that 

for the formation of a contour element (30) of a segment contour a 
predetermined number of sequential image points (26, 28, 28', 32, 
33) of the segment with polar angles which increase or reduce in a se- 
ries with respect to a predetermined polar axis are associated with a 
corresponding contour element and 

in that data of the contour element is determined from the image 
point (26, 28, 28', 32, 32). 
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Method in accordance with one of the claims 3 to 5, 
characterized in that 

for the formation of a contour element (30, 38, 42) of a segment 
contour respective sequential image points (26, 28, 28', 32, 33) of the 
segment in a series of increasing or decreasing polar angle with re- 
spect to a predetermined polar axis are associated with a correspond- 
ing contour element the spacing of which from a first image point (26) 
associated with the contour element is smaller than a predetermined 
maximum spacing and 

in that data of the contour element are determined from these image 
points (26, 28, 28', 32, 33). 

Method in accordance with one of the claims 3 to 6, 
characterized in that 

contour elements are obtained by vectorization of a curve which 
arises by connecting the image points (26, 28, 28', 32, 33) of a seg- 
ment in a series of increasing or decreasing polar angle with reference 
to a predetermined polar axis. 

Method in accordance with one of the claims 3 to 7, 
characterized in that 

the positions of the image points (26, 28, 28', 32, 33) of a segment are 
subjected to low pass filtering prior to the formation of the contour 
elements. 

Method in accordance with one of the claims 3 to 8, 
characterized in that 
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a quality is associated with at least one contour element which de- 
pends on the position of the image points (26, 28, 28\ 32, 33) used 
for the determination of the contour element. 

5 10. Method in accordance with one of the preceding claims, 
characterized in that, 

for the prediction of the position of an object contour in a current 
cycle, an object speed determined in a preceding cycle is used. 

10 11. Method in accordance with one of the preceding claims, 
characterized in that 

a capture region is associated with each object and in that a segment 
contour of a segment is only compared with an object contour of an 
object in the capture region of which at least one reference point of 
15 the respective segment lies. 

12. Method in accordance with one of the preceding claims, 
characterized in that, 

for the comparison of a segment contour with an object contour, an 
20 association quality is determined for a segment and an object which 

is a measure for the agreement of the respective contours with re- 
spect to position and/ or shape and in that a segment which can be 
associated with two objects is associated with that object for which it 
has the best value of the association quality. 
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13. Method in accordance with claim 12 and one of the claims 3 to 9, 
characterized in that, 
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from pairs respectively consisting of a contour element of the segment 
contour and a contour element of the object contour, differences are 
determined between corresponding data of the contour elements and 
in that the association quality is determined using the differences. 

5 

14. Method in accordance with claim 12 or 13 and one of the claims 3 to 
9, 

characterized in that 

pairs respectively consisting of a contour element of the segment 
10 contour and a contour element of the object contour are determined 

among the contour elements of the segment contour and the contour 
elements of the object contour which at most differ in one item of the 
data by a predetermined amount and in that the number of these 
pairs is determined for the determination of the association quality. 

15 

15. Method in accordance with one of the claims 12 to 14 and one of the 
claims 3 to 9, 

characterized in that 

pairs respectively consisting of a contour element of the segment 
20 contour and a contour element of the object contour are determined 

among the contour elements of the segment contour and contour 
elements of the object contour for which position coordinates have a 
spacing which is smaller than a predetermined maximum pair spac- 
ing and in that the number of these pairs is determined for the de- 
25 termination of the association quality. 

16. Method in accordance with one of the claims 12 to 15 and one of the 
claims 3 to 9, 
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characterized in that 

for the determination of the association quality a contour element of 
the segment contour and a contour element of the object contour are 
determined for which the position coordinates have the smallest 
5 spacing among all pairs of contour elements of the segment contour 

and contour element of the object contour. 

17. Method in accordance with one of the preceding claims, 
characterized in that 

10 two or more segments are only then associated with an object when a 

spacing of the segments from the object is respectively smaller than a 
predetermined maximum spacing. 

18. Method in accordance with one of the preceding claims, 
15 characterized in that 

a hiding recognition is executed during the association of segments to 
objects. 

19. Method in accordance with one of the preceding claims, 
20 characterized in that 

when recognizing at least two segments which can be associated with 
the same object, but which should not both be associated with the 
same object, the segment with the better association quality is asso- 
ciated with the object. 
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20. Method in accordance with one of the preceding claims, 
characterized in that 
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for the determination of the object speed a difference is determined 
between the position and/ or the orientation of the current object con- 
tour and the position and /or orientation of the object contour in the 
preceding cycle or the predicted object contour. 

Method in accordance with claim 3 and one of the claims 4 to 20, 
characterized in that 

in the determination of the difference between the position and /or 
orientation of the object in the current cycle and the position and/or 
orientation of the object contour in the preceding cycle, or the pre- 
dicted object contour, contour elements (42) of the current object 
contour and contour elements (38) of the object contour in the pre- 
ceding cycle or of the predicted contour are associated with one an- 
other and in that the change of the position and /or orientation of the 
object contour in the preceding cycle to that in the current cycle is 
determined from those contour elements (42) of the current contour 
which are associated with contour elements (38) of the object contour 
in the preceding cycle or of the predicted object contour. 

Method in accordance with claim 3 and one of the claims 4 to 2 1 , 
characterized in that 

for the association of contour elements (38, 42) of two object contours 
relative to one another, starting from contour elements (44, 44') of the 
object contours with position coordinates which respectively corre- 
spond to one end of the contour, a search is in each case made, for 
sequential contour elements along one of the two contours, for a cor- 
responding not yet associated contour element of the other contour of 
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which the position coordinates have a minimum spacing from the po- 
sition coordinates of the contour element of the one contour. 

23. Method in accordance with claim 3 and one of the claims 4 to 22, 
5 characterized in that in each case at least one reference element (44, 

44") is determined for an object contour (38, 42); in that, for the asso- 
ciation of object elements (38) of the predicted contour and object 
elements (42) of the current object contour, a correction shift is found 
between the reference elements (44, 44') of the predicted contour and 
10 the current contour and in that the association of contour elements 

of the predicted contour to contour elements of the current contour 
takes place using the contour elements of the predicted contour 
shifted by the correction shift of the reference elements. 

15 24. Method in accordance with claim 3 and one of the claims 4 to 23, 
characterized in that 

differences between the position coordinates of mutually associated 
contour elements (42; 38) of the current contour and of the contour 
determined in the preceding cycle or of the predicted contour are first 
20 determined; in that a translation and/or a rotation of the object be- 

tween the preceding cycle and the current cycle is determined from 
these differences and in that the object speed is determined on the 
basis of this translation and/ or rotation. 
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25. Method in accordance with one of the preceding claims, 
characterized in that 

the object speeds are subjected to a low pass filtering operation. 
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26. Computer program having program code means for carrying out the 
method in accordance with one of the claims 1 to 25 when the pro- 
gram is executed on the computer (24). 

5 27. Computer program product with program code means which are 

stored on a computer readable data carrier in order to carry out the 
method in accordance with one of the claims 1 to 25 when the com- 
puter program product is executed on a computer (24). 

10 28. Apparatus for the recognition and tracking of objects with at least one 
optoelectronic sensor (10), in particular a laser scanner, the viewing 
range of which includes the detection range (14) and 
a data processing device (24) associated with the optoelectronic sen- 
sor (19) which is designed to carry out the method in accordance with 

15 one of the claims 1 to 25. 



